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METHOD AND SYSTEM FOR ESTIMATING PERFORMANCE METRICS IN A 



This application claims the benefit of U.S. Provisional Application No. 
60/157,155, filed September 30, 1999, the entire contents of which are incorporated by 
reference. 



The present invention relates to packet-switched communication networks, and 
more particularly to a method and system for estimating traffic between sources and 
destinations in a communications network. 



Many Internet Service Providers ("ISPs") provide Enhanced Internet Protocol 
("EIP") real time services such as voice-over IP, fax -over IP, unified messaging, and 
Internet call waiting over the IP network. The EBP real-time services differ from non-real 
time, best-effort services provided over Transmission Control Protocol ("TCP"); unlike 
best-effort services, EIP services have end-to-end quality of service (QOS) requirements 
for packet loss, delay and delay jitter. As a result, providing EIP services requires new 
processes for network resource planning. 

Current processes are mostly based on a simple calculation of network link usage. 
However, this method of planning may result in poor quality for EIP services because it 
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fails to address or estimate end-to-end QOS requirements, such packet loss, delay and 
delay jitter. 

Although these problems have been addressed by prior art methods, many known 
methods make Poisson arrival and/or exponential packet length assumptions about 

5 service traffic characteristics. In most cases, these assumptions are not applicable for EIP 
service traffic because different types of services have different packet length and inter- 
arrival distributions. Even for the same service, e.g. Voice over IP ("VoIP"), different 
voice encoders generate different traffic statistics. When silence compression capability 
is de-activated in the encoders, the resulting voice traffic consists of packets with 

10 constant length and constant inter-arrival time. Once the silence compression capability 
is activated, packet inter-arrival times vary. 

Given the mix of many types of deterministic and non-deterministic service 
traffic, approaches using large deviation theory to estimate end-to-end QOS have been 
suggested. However, large deviation theory-based estimates assume that there are a fixed 

15 number of active sources feeding the network. For example, large deviation theory 
calculations may assume that there are ni voice calls, n 2 fax calls, and n3 e-mail 
messaging calls, nj, n 2 , and n 3 being fixed numbers, which are active and that generate 
traffic at any given time. In reality, the number of active sources feeding the network 
varies over time because calls are constantly connected and disconnected over any given 

20 time period, thereby increasing or decreasing, respectively, the total number of active 
calls. Thus, a direct application of the large deviation theory as taught by the known art 
is not the most appropriate method for estimating end-to-end QOS. 
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There is need for a process that estimates end-to-end packet loss, delay, and delay 
jitter for EIP network planning using the large deviation theory while taking into account 
changes in the number of active sources feeding the network. 



Accordingly, the present invention is directed to a method for estimating end-to- 
end quality of service (QOS), such as packet loss, delay and delay jitter, in an enhanced 
DP network for use in network planning. The inventive method includes estimating the 
blocked traffic and carried traffic from each gateway in the network, determining a 
possible number N of active sources, using a network routing algorithm to estimate the 
carried traffic for each network link, calculating at least one QOS characteristic for each 
network link by varying the number N for each calculation, and estimating an end-to-end 
QOS characteristic by summing the QOS characteristics for the network links. The 
inventive method therefore enhances network planning by explicitly taking into account 
variances in the number of sources when estimating end-to-end QOS, thereby more 
reflecting real-world operation more accurately. 



SUMMARY OF THE INVENTION 



BRIEF DESCRIPTION OF THE DRAWING 
Figure 1 is a flowchart illustrating one embodiment of the inventive method. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Figure 1 illustrates a preferred embodiment of the inventive method. As is known 
in the art, an Internet Protocol ("IP") network contains inter-connected routers. To 
provide real time IP ("EIP") services, gateways are deployed at the edge of an IP 

5 network. A gateway is connected to a public switched telephone network ("PSTN") 
through Primary Rate Interface ("PRI") links on one side and to the IP network on the 
other side. The gateway translates between the PSTN and IP networks. 

During network planning, offered call rates to each gateway are estimated. 
Because each gateway has only a limited number of available PRI links, some of the 

10 offered calls may be blocked. Moreover, calls of one service type may experience a 
higher blocking probability than calls of another type. An equation described in 
Kaufman, "Blocking in a Shared Resource Environment", IEEE Transactions on 
Communications , vol. COM-29, No. 10, October 1981, incorporated herein by reference, 
is used to determine the probability that calls will be blocked or carried by the network at 

15 step 100. Kaufman's algorithm is preferred over an Erlang blocking model because 
Kaufman's algorithm gives blocking probabilities per type, whereas the Erlang model 
provides only the blocking probability for the aggregate of all calls. 

The method generally involves first computing the QOS for each individual link 
and then using the individual link information to estimate the end-to-end QOS. More 

20 particularly, steps 102 through 106 involve calculating QOS for each individual link, 
while steps 108 through 112 use the data obtained with respect to the individual links to 
estimate end-to-end QOS. At step 102, the process uses the routing algorithm of the IP 
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network to estimate, in Erlangs, the load carried by each link. As understood by those 
skilled in the art, an Erlang is defined as the aggregate of continuous occupation of a 
channel for one hour, where an intensity of one Erlang means the channel is continuously 
occupied. 

The packet loss at a router output link is calculated at step 104. In this step, it is 
assumed that the bandwidth available to EBP services at a router link is C. In this 
calculation, it is assumed that there are N, independent sources of type /, where i = 1, 
...,K. Two calls are of the same type if they present same traffic statistics, usually if they 
employ the same type of voice encoder. For example, a VoIP call and a Voice messaging 
call may be of the same type if they both use the ITU G.729 standard with silence 
compression. For each source of type /, R, and R t denote the maximum and average 
traffic rate of the type i source. Further, in the calculations below, N = (Nj, . . .NO, Ri = 
(Ri , . . .R0, R s =(/?!,... R k ). The value N can be either assumed or determined to take 
on different values to take into account the fact that the number of active sources varies 
over time in a real-world network. 

Also in the calculation of packet loss for a single output link, for a single source 
of type /, Ai(t) denotes the number of arrivals of a single type i source in period (0,t). Its 
asymptotic log moment generating function is: 



Y,(0) = lim 



logEre eA , (t) l 



(1) 



t 
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The effective bandwidth function of the type /' source is: 



ai (0) =Jil&L_ 

e 



(2) 



Next, let G = {N :[N • R]> C and [N • R) < C) , where [N • R] denotes a scalar 
product of N and R. If the scalar product N • R is less than C, there is no queuing, and 
therefore no packet delay even if all of the sources transmit at peak rate because the 
queue has not yet been saturated; in this case, packet delay is caused only by transmission 
delay. If the scalar product is greater than C, however, the queue is saturated and will 
experience delays due to an overload of the link. Next, the following equation is solved 
for 0 . 8(N) is defined as the solution for this equation and will be referenced below in 
equation (4). 



Next, b is defined as the buffer size of the router output buffer assigned to EIP services. 
According to large deviation theory, which is known in the art: 
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where PC^blN) is the loss probability conditioned on N. 

The above definitions and calculations will now be used to calculate the packet 
loss at the router output link, taking into account changes in the number of active sources 

5 N over time. More particularly, when a type i call is admitted into the network and starts 
to generate packets, it becomes a new active source of type i. When the call completes, 
the number of active sources N is reduced by one; as a result, N varies over time as calls 
enter and leave the network. During peak times, there are typically a large number of 
active sources feeding the link. A Poisson distribution can model the number of active 

10 sources in the link as follows: 



p(N)=n fi/v p < (5) 

,= i Nil 



« 15 

U 

ru 



where pi is the offered load of type i service in Erlang. Removing the dependence on N, 
the probability of packet loss at a router output link is as follows: 

20 P{Q>b) = Y< P(N)xe bm + 2 P(N) (6) 

NeG Ne{|N.R|}>C 

25 The calculation in equation (6) takes into account the fact that N varies over time by 
summing, over all possible values of N, the less probabilities P(Q>b|N) weighted by the 
probability that N occurs. This expression also assumes that the number of active sources 
will vary slower than the contents in the buffer. As a result, this estimate more closely 
reflects the way in which active sources feed into the link. 
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Next, at step 106, the inventive method calculates the packet delay for an 
individual router output link. In this calculation, D is a random variable representing the 
packet delay at a router output link. The packet delay distribution may be obtained from 
packet loss at the router output link, which was calculated in step 104, as follows: 



where C is the output link speed. 

At this point, the probability of both packet loss and packet delay at an individual 
router output link has been calculated for all possible values of N active sources, thereby 
taking into account changes in the number of active sources in the network. Next, steps 
108 through 112 take the single link statistic calculations from steps 102 through 106 and 
use them to calculate end-to-end packet statistics. 

Step 108 of the inventive method involves calculating the end-to-end packet loss. 
In this calculation, it is assumed that the losses occur independently along the end-to-end 
path and that there are a total number of L router output links. Preferably, the loss and 
delay characteristics for each one of the L router output links is calculated according to 
steps 104 and 106 described above. With respect to the end-to-end packet loss 
calculation at step 108, /?, is defined as the loss probability of an ith link along the path. 
The total end-to-end loss probability along the path is then calculated to be: 



P(D>d) = P(Q/C>d) = P(Q>dC) 



(7) 



L 



1-11 (1-p,) 



(8) 



1=1 
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Next, the end-to-end packet delay is calculated at step 1 10. In this calculation, it 
is assumed that the delay for each individual packet occurs independently, without being 
influenced by delays in other packets along the path. To calculate the end-to-end packet 
delay, fi( x) is the delay distribution of the ith link along the path. The end-to-end delay 
distribution along the path is therefore defined as: 



where f(x) is the end-to-end delay distribution and ® denotes convolution. More 
specifically, the end-to-end delay distribution is the convolution of the link delay 
distributions along the path. 

Next, at step 112, the inventive process calculates the end-to-end packet delay 
jitter. In this step, the user can select a specific delay jitter percentage p for the 
computation (e.g., 95%, 98% or 99% delay jitters). Delay jitter is defined as t 2 -t|, where 
(100-p)/2 percent of packets experience delays less than U ms and(100-p)/2 percent of 
packets experience delays greater than t 2 ms. In particular, ti and t 2 are found by solving 
the following equations. 



Thus, the inventive method estimates end-to-end QOS by first estimating the 
amount of traffic blocked and carried by the network, preferably using Kaufman's 
algorithm, estimating single link statistics for each individual router output link in a path, 
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taking into account variations in the number of active sources, and then using the single 
link statistics to calculate end-to-end QOS. In these calculations, it is assumed that the 
estimates of offered traffic for each service to each gateway is given, preferably in 
Erlangs. By calculating the loss and delay probability for all possible N number of active 
5 sources, as described by way of example in Equations (5) through (10), the inventive 
method provides a better estimate of network traffic because it considers the fact that the 
number of active sources will vary over time. 

The inventive method can be carried out in any known network system. The 
^3 system can include a database that contains the parameters (e.g. service type and 

rj,! i 
h. i 

r\ 10 characteristics) for each gateway in the system, a memory that stores an end-to-end 
~r; quality service program corresponding to the inventive method, and a processor that 

i : I 

I" executes the end-to-end quality service program according to the steps shown in Figure 1. 

□ 

yg From the inventive method, the system can output network information such as Wide 

%y Area Network ("WAN") link utilization; one-way packet loss; one-way and two-way 

E3 15 packet delay and delay jitter; gateway Primary Rate Interface ("PRI") link utilization and 
blocking probabilities per physical location; and/or global maximum PRI link utilization 
and maximum blocking probability. 

An Internet Service Provider ("ISP") can therefore estimate network performance 
using the inventive method and system and, if QOS requirements are not met, reallocate 
20 sources and conduct the inventive method again quickly and easily to assess the effect of 
the reallocation on network performance. For example, the ISP may experiment with 
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different traffic scenarios to distribute global origination traffic among network cities in 
different ways. 

It should be understood that various alternatives to the embodiments of the 
invention described herein may be employed in practicing the invention. It is intended 
that the following claims define the scope of the invention and that the method and 
apparatus within the scope of these claims and their equivalents be covered thereby. 
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